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DETAILED ACTION 

1. This communication is responsive to Amendment filed 12/23/2005. 

2. Claims 1-24 are pending in this application. Claims 1, 7, and 17-20 have been amended, 
and claims 22-24 have been added. This action is made Final. 

Claim Rejections - 35 USC § 102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S. C 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

4. Claims 1-9, 17-21 and 23 are rejected under 35 U.S. C. 102(b) as being anticipated by 
Raman et al. ("Raman", US 5,572,625). 

As per claim 1, Raman teaches a screen reader software product comprising: 

a screen reader module communicatively coupled with resident software on a computer, 
the reader module adapted to collect textual and non-textual display information generated by the 
resident software (col.4, lines 21-38); 

a broadcast module communicatively coupled to the reader module, the broadcast module 
adapted to communicate the display information collected by the reader module to an output 
device (col.4, lines 46-55); and 

a schema module communicatively coupled to the broadcast module, the schema module 
adapted to send non-textual display information with associated textual display information to 
the output device in substantially concurrent fashion (col. 3, lines 44-50). 
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As per claim 2, Raman teaches the output device to be a speech synthesizer (col. 4, lines 

50-55). 

As per claim 3, Raman teaches the software product wherein the non-textual display 
information is selected from the group consisting of font format, paragraph format, bulleting, 
numbering, borders, shading, column format, page breaks, section breaks, tab settings, table 
structure, image data, case settings, comment field locations, hyperlink settings, data entry forms, 
and graphic user interface configuration (col. 15, lines 10-20; col. 20, lines 66-67; col. 22, lines 15- 
17). 

As per claim 4, Raman teaches the software product wherein the schema module 
modifies the broadcast of the textual display information to communicate the non-textual display 
information by altering characteristics of the speech synthesizer, the characteristics selected from 
the group consisting of pitch, speed, volume, emphasis, simulated gender, simulated accent, 
simulated age, and pronunciation (col.18, lines 49-55; col.21, lines 20-21). 

As per claim 5, Raman teaches the software product wherein the schema module includes 
an additional audio output layer to the broadcast of the textual display information to audibly 
communicate the non-textual display information in substantially concurrent fashion with the 
synthesized text (col.3, lines 3-7). 

As per claim 6, Raman teaches the software product wherein the additional audio output 
layer broadcasts a pre-selected sound associated with the non-textual display information (col. 15, 
lines 10-20, predetermined rules decide the sound associated with non-textual information). 

As per claim 7, Raman teaches the software product wherein the pre-selected sound is 
end-user-definable (col. 9, lines 35-46). 
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As per claim 8, Raman teaches the software product wherein pre-selected sound is 
selected from the group consisting of dynamically generated sound and prerecorded digital audio 
(col.9, lines 35-41). 

As per claim 9, Raman teaches the software product wherein the schema module includes 
a plurality of additional audio outputs layer to the broadcast of the textual display information to 
audibly communicate a corresponding plurality of non-textual display information in 
substantially concurrent fashion with the synthesized text (col.3, lines 3-7; col. 15, lines 18-20). 

As per claim 17, Raman teaches a screen reader software product comprising: 

a screen reader module communicatively coupled with resident software on a personal 
computer, the reader module adapted to collect textual and non-textual display information 
generated by the resident software (col.4, lines 21-38), 

the non-textual display information is selected from the group consisting of font format, 
paragraph format, bulleting, numbering, borders, shading, column format, page breaks, section 
breaks, tab settings, table structure, image data, case settings, comment field locations, hyperlink 
settings, data entry forms, and graphic user interface configuration (col. 15, lines 10-20; col. 20, 
lines 66-67; col.22, lines 15-17); 

a broadcast module communicatively coupled to the reader module, the broadcast module 
adapted to communicate the display information collected by the reader module to speech 
synthesizer (col.4, lines 46-55); and 

an end-user-definable schema module communicatively coupled to the broadcast module, 
the schema module adapted to send non-textual display information with associated textual 
display information to the output device in substantially concurrent fashion whereby the schema 
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module modifies the broadcast of the textual display information to communicate the non-textual 
display information by altering characteristics of the speech synthesizer (col.3, lines 44-50), 

the characteristics selected from the group consisting of pitch, speed, volume, emphasis, 
simulated gender, simulated accent, simulated age, and pronunciation (col. 18, lines 49-55; 
col.21, lines 20-21). 

As per claim 18, Raman teaches a screen reader software product comprising: 

a screen reader module communicatively coupled with resident software on a personal 
computer, the reader module adapted to collect textual and non-textual display information 
generated by the resident software (col.4, lines 21-38), 

the non-textual display information is selected from the group consisting of font format, 
paragraph format, bulleting, numbering, borders, shading, column format, page breaks, section 
breaks, tab settings, table structure, image data, case settings, comment field locations, hyperlink 
settings, data entry forms, and graphic user interface configuration (col. 15, lines 10-20; col. 20, 
lines 66-67; col.22, lines 15-17); 

a broadcast module communicatively coupled to the reader module, the broadcast module 
adapted to communicate the display information collected by the reader module to speech 
synthesizer (col.4, lines 46-55); and 

an end-user-definable schema module communicatively coupled to the broadcast module, 
the schema module adapted to send non-textual display information with associated textual 
display information to the output device in substantially concurrent fashion (col.3, lines 44-50) 
whereby the schema module includes an additional audio output layer (col.3, lines 3-7) to the 
broadcast of the textual display information to audibly communicate the non-textual display 
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information as an end-user-definable pre-selected sound selected from the group consisting of 
dynamically generated sound and prerecorded digital audio in substantially concurrent fashion 
with the synthesized text (col. 9, lines 35-46). 

Claim 19 is similar in scope to claim 7, and is therefore rejected under similar rationale. 

As per claim 20, Raman teaches the software product wherein a plurality of end-user 
schema definitions are assignable to specific resident software applications (col. 19, lines 27-38). 

As per claim 21, Raman teaches the software product wherein end-user schema 
definitions generated by an end user are shareable with other users (col. 19, lines 27-38, rules can 
be shared to other users through a file). 

As per claim 23, Raman teaches the software product wherein the non-textual display 
information is style information (col. 20, lines 7-10). 

Claim Rejections -35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

6. Claims 10-13, 15 and 24 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Raman et al. ("Raman", US 5,572,625) in view of Giuliani et al. ("Giuliani", US 2002/0105496). 

As per claim 10, Raman teaches outputting of textual and non-textual display 
information. However, Raman does not teach the output device to be a Braille display. Giuliani 
teaches the output of textual and non-textual display information to be a Braille display (para.3, 
lines 1-4; para. 18, line 4; para.21, lines 9-1 1). It would have been obvious to one of ordinary 



Application/Control Number: 1 0/7 1 0,9 1 0 Page 7 

Art Unit: 2174 

skill in the art at the time of the invention to include Giuliani's teaching with Raman's product in 
order to allow the blind the opportunity to read and determine the attributes associated with text 
via different senses. 

As per claim 11, Giuliani teaches the software product wherein the non-textual display 
information is selected from the group consisting of font format, paragraph format, bulleting, 
numbering, borders, shading, column format, page breaks, section breaks, tab settings, table 
structure, image data, case settings, comment field locations, hyperlink settings, data entry forms, 
and graphic user interface configuration (para,42, lines 6-9; para.43). 

As per claim 12, Giuliani teaches the software product wherein the schema module 
modifies the broadcast of the textual display information to communicate the non-textual display 
information by altering tactile characteristics of the Braille display (para.42-43). 

As per claim 13, Giuliani teaches the software product wherein the tactile characteristics 
of the Braille displayed modified by the schema module are selected from the group consisting 
of display speed, pin protrusion level, pin retraction level and pin vibration (para.42-43). 

As per claim 15, Raman teaches the software product of claim 1 wherein the output 
device is a speech synthesizer. However, Raman does not disclose the output device to be an 
array of a speech synthesizer and a Braille display, the speech synthesizer audibly broadcasts 
textual display information and the Braille display tactically outputs non-textual display 
information in substantially concurrent fashion. Giuliani teaches the output of textual and non- 
textual display information to be on a Braille display (para.3, lines 1-4; para. 18, line 4; para.21, 
lines 9-11). It would have been obvious to one of ordinary skill in the art at the time of the 
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invention to combine Giuliani's teaching with Raman's product in order to allow blind users the 
opportunity to listen to and visualize the display through touch. 

As per claim 24, Raman teaches software product of claim 23 wherein the non-textual 
display information is style information (Raman, col.20, lines 7-10). However, Raman does not 
explicitly teach the style information to be selected from the group consisting of bold, italics, 
underline and font color. Giuliani teaches the output of non-textual display information to consist 
of bold text (para.42). It would have been obvious to one of ordinary skill in the art at the time 
of the invention to combine Giuliani's teaching with Raman's product in order to enhance the 
user's reading experience. 

7. Claims 14 are rejected under 35 U.S.C. 103(a) as being unpatentable over Raman et al. 
("Raman", US 5,572,625) in view of Burchart ("Burchart", US 4,836,784). 

As per claim 14, Raman teaches the software product of claim 1 to communicate textual 
and non-textual display information to an output device. However, Raman does not teach the 
output device to be an array of two Braille displays, a first Braille display outputs textual display 
information and a second Braille display outputs non-textual display information in substantially 
concurrent fashion. Burchart teaches the output of both textual information and graphics on an 
array of Braille displays (Fig.2-6; col. 5, lines 38-64; claiml). It would have been obvious to one 
of ordinary skill in the art at the time of the invention to incorporate Burchart' s teaching with 
Raman's product in order to communicate graphic displays in addition to textual information to 
accommodate the blind and thereby enhancing the viewing experience of the blind user 
(Burchart, coll, lines 25-34, 47-52). 
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8. Claim 16 is rejected under 35 U.S.C. 103(a) as being unpatentable over Raman et al. 
("Raman", US 5,572,625) in view of Rohen ("Rohen", US 5,186,629). 

As per claim 16, Raman teaches outputting of textual and non-textual display information 
to a speech synthesizer. However, Raman does not teach the output device to be an array of a 
speech synthesizer and a vibratory apparatus, the speech synthesizer audibly broadcasts textual 
display information and the vibratory apparatus vibrates at pre-selected frequencies responsive to 
non-textual display information in substantially concurrent fashion. Rohen teaches an output 
device which audibly and tactilely outputs textual and non-textual display information 
respectively (col. 6, lines 23-32; col.7, lines 7-16). It would have been obvious to one of ordinary 
skill in the art at the time of the invention to include Rohen' s teaching with Raman's product in 
order to allow blind users the opportunity to visualize the display through the use of multiple 
sensory functions rather than solely by means of sound. 

9. Claim 22 is rejected under 35 U.S.C. 103(a) as being unpatentable over Raman et al. 
("Raman", US 5,572,625) in view of Carro (US 2004/0091842). 

As per claim 22, Raman teaches non-textual display information to be inserted into 
documents using markup languages (Raman, col.4, lines 1-21). However, Raman does not 
explicitly teach the non-textual display information to be selected from the group consisting of 
hyperlink settings, data entry forms, and graphic user interface configuration. Carro teaches a 
method enabling blind users to detect hyperlinks through non-textual display information 
(para.57). It would have been obvious to one of ordinary skill in the art at the time of the 
invention to include Carro's teaching with Raman's product in order to allow blind users an 
enhanced method of accessing web documents. 
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Response to Arguments 

10. Applicant's arguments filed 12/23/05 have been fully considered but they are not 
persuasive. 

Applicant argued the following: 

a) Raman does not teach a screen reader software product with a reader module. 
The Examiner disagrees for the following reasons: 

Per a), according to the Applicant's arguments "Screen readers.. are systems that output 
the contents of the computer screen., .to a user, typically one who is blind..". Raman clearly 
teaches a screen reader which converts text from a computer display to speech intended for use 
by the visually impaired (col.l, lines 13-21) therefore a screen reader software product with a 
reader module is taught by Raman. 

Conclusion 

11. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 
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Communications 



12. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Sajeda Muhebbullah whose telephone number is (571) 272-4065. 
The examiner can normally be reached on Tuesday/Thursday or alt. Mondays from 8:00 am to 
4:30 pm (EST). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Kristine Kincaid, can be reached on (571) 272-4063. 

The fax number for the organization where this application or proceeding is assigned are 
as follows: 

(571) 273-8300 [After Final Communication] 

(571) 273-8300 [Official Communication] 

(571) 273-8300 [For status inquiries, Draft Communication] 

Sajeda Muhebbullah 
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